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1. Abstract J 

IhiA^per-extendsJcIneinatlc resol ved-rate control from one robot ar*4o the coordinated control 
of multiple robot arms In the movement of an object. The structure supports the 9* n * ra1 . 

one axis system (moving reference frame) with respect to another axis system (control reference frame) 

SJ oSror i^rfrobot a?ms. The grippers of the robot arms do not have to be parallel or «t *ny pre- 
disposed positions on the object. For multiarm control, the operator chooses the “"e moving and 
control reference frames for each of the robot arms. Consequently, each arm then moves as though 
It were carrying out the commanded motions by itself. 

2. Introduction 

In the Intelligent Systems Research Laboratoif (ISRL) at the Langley Research Center, an operator sits at a 
remote console with a six-axis hand control l/r and commands the motion of a robot arm. The 
oDtlonal control modes, but of particular Interest In this paper Is kinematic resolved-rate control tl], which, 
for example enables the operator to dlreclfly control the robot hand. The operator views the robot hand, 
decides "that he wants It to move In a cert/in direction, and commands a velocity 1n ^ t t !’*^ 1 d1 ^ c A 1 . on controller 
controller. The robot hand then moves In the desired direction with a velocity proportional Jf 
deflection. Comnanded hand velocities are/transformed (resolved) Into requisite movements (velocities) of the 
Individual joints In the robot arm to eyre ct the commanded hand motion. Currently, ISRL has two six- egr 
of-freedom Industrial robot arms. 

There are some tasks which can not/be done with just one robot arm, and other tasks which can be done with 
one robot arm, but not In a reasonably time. The advantage of using multiple robot arms Is e^e^ed J* 

In everyday activity. The major problem with multlarm control Is that we do not know how to control J^ot 
In a general cooperative manner to accomplish a task. As noted In [23. the study of coordination problems 
between two robots doing a single^ job Is In Its Infancy. Even then, work in dual-arm control {[23-C4], for 
example) has dealt mostly with the master/slave architecture — which Is not of Interest In the present paper. 
Recently however, Hayatl [5] p/oposed an Interesting control architecture for posit! on/force- torque control of 
multlarm* cooperating robots. / But, Implementing this solution would require precise knowledge of the mass 
property of the arms 9 as well as the object that Is being grasped. In the present paper a sira P|® 
mass properties) solution If devised and then Implemented using two Industrial robot arms. 
the well-known kinematic resol ved-rate control Is extended from the control of one robot arm to the coordinate 
control of multiple robot arms. 

Resolved-rate control appears to be a natural way not only to move an object with one 
with multiple robot arms. After symbols/strings and axis systems are specified, equations ^or 

the general movement of one axis system (moving reference frame) with respect to another axis system (contro 
reference frame) — first, by one robot arm and then by multiple robot arms. 


3. Symbols /Strings 
alpha 

base 

erf 

hnd 

1, j, k 

matrl x_f rom_#_to_## 
mrf 


a real number that locates a point along a line between two selected robot grippers 
or tools 

base axis system 

control reference frame for operator inputs 

hand axis system 

integers 


r_matr1x_frc.m_#_to_## | vector_from_##_to_# 

0 0 0 I 1 


moving reference frame 
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number of robot arms 
object axis system 

rotational transformation matrix from axis system # to axis system ##; 3X3 matrix 
In upper left corner of the homogeneous transformation matrix from # to f# (1.e.» 
ma trl x_f romJMto _#■ # ) 

robot arm associated with Integer 1 

attribute # (such as axis system or velocity) of robot(l) 

rotational velocity In axis system # 

station axis system, which Is known with respect to the world axis system 
tool axis system 

translational velocity In axis system # 
vector from # to ## 

v«ctor_crossj>roduct_q_# vector q In axis system # resulting from cross-product operation 

vector_Jnput_q_# operator vector input q In axis system # 

world world axis system 

Mote: In equations, an asterisk (*) denotes multiplication, and x signifies a vector cross product. 

4. Axis Systems 

Axis systems allow quantities In the robot's environment to be geometrically related. Pertinent axis 
systems associated with a given robotd ) are: 

(1) Base axis system ( robot (1 ).base), which Is located at the base of robot(l). If the base moves, which 

does not happen In this paper, the homogeneous transformation from world to robotd). base is updated 

to reflect this movement. 

(2) Control reference frame (robot(1 ).crf ), which is an axis system on or off robot(l) that is selected by 

the operator for his velocity Input to direct the moving reference frame. This frame may coincide with 
the moving reference frame or any other convenient axis system. Default of robot(i).crf Is 

robotd ). tool . 

(3) Hand axis system (robotd ).hnd), which Is a moving axis system representing the hand of robot(1 ). 

(4) Moving reference frame (robotd ).mrf), which Is a definable axis system that Is moved by the robot hand 
with respect to a control reference frame. Default of robotd }.mrf Is robotd ). tool . 

(5) Object axis system (robotd ).obj), which refers to an object associated with robot(l). Default of 
robotd ).obj Is robotd). tool. 

(6) Station axis system (robotd ).sta), which Is known with respect to the world axis system and does not 

move with Joint-angle changes In robotd /. Default robotd ).sta Is the world axis system. 

(7) Tool axis system (robotd ). tool ), which Is located on a tool attached or held In the hand of robotd ). 
Default robot(l). tool Is rob0t(1).hnd. 

(8) World axis system (world). In which the positions of each base and station axis system are known. When 
movement only Involves a single robot arm, default world Is the base axis system of that robot arm. 

Moreover, each joint In the robot arm has an associated joint axis system. The first three Joints are 
sometimes referred to as the base or waist, shoulder, and elbow joints. The latter three Joints constitute the 
robot wrist. Other axis systems not used In this paper are those associated with cameras, sensors, and goals. 

5. Single Robot Arm Control 


n 

obj 

rjaatrl x_f rom_#_to_# # 

robotd) 
robotd ).# 
rvel_# 
sta 
tool 
tvel J 

vector from # to ## 


In general (fig. 15, an operator commands a velocity (expressed In a control reference frame 
(robotd ). erf)) to direct the movement of a moving reference frame (robotd ).mrf). The moving reference frame 
Is actually moved by the robot hand (robotd ). hand). The required velocity of the robot hand Is subsequently 
calculated as a consequence of the commanded velocity for this movement. 
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The homogeneous transformation matrix from the control reference frame to the moving reference frame Is 
computed as 

matr1x_fromjrobot(1 ).crf_toj' 0 bot (1 ).mrf 

■ tna trl x_from_worl d_to_robot { 1 ) . mrf 

* matr1x__fromjrobot(1 ).crf_to_wor1d (1) 

where the matrices on the right side of equation (1) are available when the moving and control reference frames 
are selected. 

The operator issues velocity commands In the control reference frame to direct the moving reference frame. 
In the moving reference frame of robotd), the translational velocity {tvel) and the rotational velocity (rvel ) 
that correspond to these commands are 

vector__robot{1 ).rvel mrf ■ rjnatr1x_from_robot{1 ).crf_to_robot(1 ).mrf 

* vector_j1nput_robot{1 l.rveljcrf (2) 

vector_robot{ 1 ) . tvel jnrf • rjaatrl x_f rom_robot(1 ) .crf_to_robot( 1 ) .mrf 

* vectorj npu t_robot ( 1 ) . tvel jcrf 

* vector_crossjproduct_robot(i htveljmrf (3) 

where 


vec to r_c r o s s_p r o due t_r ob o t ( 1 ) . t ve 1 _mr f 

* - vector input robot (1 J.rveljcr? 

x vector_from_robot{1 ).mrf_to_robot( 1 ) -erf (4) 

In response to an operator rotational velocity Input In the control reference frame, equation (4) makes the 
origin of the moving reference frame translate In a circular motion about the commanded rotational velocity 
vector. If It Is desired that the moving reference frame only change Its orientation and not translate in 
response to a rotational velocity command, then equalon (4) Is not used. 

The homogeneous transformation matrix from the moving reference frame to the robot hand Is computed as 

matrl x_f rom_robot ( 1 ) .mrf_to_robot ( 1 ) . hnd 

= matrl x_f rom_worl d_to_robot( 1 ) .hnd 

* matrl x_from_robot(1 ).mrf_to_world (5) 

where the elements of the first homogeneous transformation matrix on the left side of equation (5) Is a known 
function of the robot joint variables. 

To cause the moving reference frame to move with the commanded velocities, the hand axis system must move 
with the velocities: 


vector_robot(1 ).rvel_hnd * r matrl x_from_robot(1 }.mrf_to_robot(i }.hnd 

* vector_input_robot(1 ).rvel_mrf (6) 

vector_robot{1 ) .tvel_hnd * r matrl x_from_robot(i ).mrf_to_robot(1 ).hnd 

* vector_1nput_robot(1 ).tvel_mrf 

+ vector cross_product_robot{1 ).tvel_hnd (7) 

where 


vector_cross_product__robot( 1 ) .tvel_hnd 

* - vectorj nput_robot(1 ).rvel_mrf 

x vector_f rom_robot ( 1 ) . hnd_to_robot ( 1 ) .mrf ( 8 ) 

Equation (8) Is necessary because the robot hand must also translate to produce a pure rotation In the eeving 
reference frame. 
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homogeneous transforation matrices from the world to the control reference frame and from the world to th 
moving reference frame are known. 

An oDerator Is free to choose the control reference frame and the moving reference frame. For example, he 
may specify these frames by using menu selection, keyboard Inputs, or a combination of light pen (location) and 
turnball (orientation) on a graphics system. (The latter way Has not yet been Implemented In ISRL). 

6. Multiple Robot Arm Control 

The Intention In this paper Is to coswunlcate a method for coordinating multiple robot arms as they 
collective* " oJiect* V solution her, (tig. 3) is singly to choose o co-on control reference frw. 

and a coimnon moving reference frame for each of the robot arms; that is. 


(9) 

( 10 ) 

(ID 


robot(1).crf - erf 
robot (1).mrf * mrf 

An object axis system. If considered common to the robot arms. Is noted as 

robot (D.obj - obj 

Then resolved-rate control Is applied to each robot arm with respect to the contnon control r « fe ^e frame, 
equalities: 

Case 1: matr1x_from_crf_to_world * matrl x_f roo_obj_to_worl d 
matrl x_f rom_mrf_to_worl d - matrl x_from_obj_to_worl d 
Case 2: matrl x_frcm_crf_to_wor)d * matrl x_f rom_sta_to_worl d 
matrl x_from_mrf_to_world - matrl x_from_obj_to_worl d 

The first case corresponds to the movement of an object with respect to velocii ties issue. | «'! 

system; whereas, the second case corresponds to an object that is moved with velocities that are specified In a 
station axis system. A particular set of object axis systems are formulated. 

7. Object Axis System on Line Between Grasp Points of Two Selected Robot Arms 

An obiect grasped by robot arms can be maneuvered with respect to an object axis system located at a point 
(automatically commuted* on a line between the grasp points (tool axis systems) of two selected robot arms. 
For example, the operator may locate the origin oi the object axis system at. 

(1) a point midway between two selected robot tools 

(2) either robot tool 

(3) a specified distance along the line between the two robot tools 

For each robot(i), the homogeneous transformation matrix from its tool to the world axis system Is computed 
as 

matrl x_from_robot{ 1 ) .tool_to_worl d * matrl x_f rom_robot( 1 ) .base_to_worl d 

* matrl x_from_robot(1 ) .hnd__to_robot(1 }.base 

* matrl x_from_robot{1 ).tool_to_robot(1 ).hnd (12) 

where the transformation matrix from the hand to the base of a robot arm is the result of moving through the 
joint axis systems, and the transformation matrix from the tool to the hand is given. 

Let the two selected robot arms be labeled as robot(j) and robot(k). Moreover, define JHe orientation of 
the object axis system to be like that of robot(k). The position vector (needed In matrix from obj_to_worl d) 
to locate a point on the line between the tools of robot(j) and robot(k) Is computed as (fig. 41 


vector_from_wor1d_to_obj ■ alpha * (vector_from_world_to_robot(k).tool 

- vector from worl d_to_robot(j ). tool ) 


(13) 
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If the operator selects the origin midway between the tools, alpha * 1/2; If the origin Is at robot(k).tool , 
alpha » 0; and If the origin Is at robot (j). tool, alpha * 1. Other values for alpha put the origin at 
different locations along the line between the two selected robot tools. 

Here, orientation of the object axis system Is defined to be like that of the tool of robot(x). Hence, the 
required rotational matrix Is 

r_matr1x_from_obJ_to_world » r_matr1x_from__robot(lc).tool_tojvorld (14) 

which Is the rotational matrix part of equation (12), with 1 « k. 

8. Object Axis System Located at Mean Grasp Point 

The position vector needed to locate the control reference frame at the mean of the robot grasp points is 
computed as 


vectorjf rom_worl d_to_ob j * (1/n) 

* { vector_f rom_worl d_to_robot( 1 ) . tool 
+ vector from world to robot(2).tool 


+ vector_f rom_worl d_to_robot(n ) . tool ) (15) 

Orientation of the object axis system Is then defined In some convenient manner. For example, if the 
orientation of the object axis system Is like the tool axis system of robot(k) then 

r_matr1x_from_obj_to_world * rjnatrix_from_robot(k ).too!_to_world (165 

Or, If the orientation Is like that of the world axis system then 

rjnatr1x_from_obj_to_world * r_matr1x_from_world_to_world (17) 

where the matrix on the right side of equation (17) Is just the Identity rotational matrix. 

9. Concluding Remarks 

A method of controlling a robot arm Is for an operator to command the hand to move with a velocity In a 
desired direction. The commanded velocity (rotational and translational) Is then resolved Into Joint rates In 
the robot arm to actually move the hand as commanded. In the present paper, this simple me*-hod, known as 

resol ved-rate control, Is extended from the control of one robot arm to the coordinated control of multiple 
robot arms. The structure supports the general movement of one axis system (moving reference frame) with 
respect to another axis system (control reference frame) by one or more robot arms. 

The approach in this paper has been applied to two Industrial robot arms that grasp a 12-foot long aluminum 
tube, representing a structural element for space construction. The bases of the robot arms were separated by 
about 6 feet. The operator with a six-axis hand controller successfully translated and rotated the tube with 
respect to an axis system on the tube. Gross movements of the tube were accomplished with no force/torque 
feedback. 

10. References 

[1] Daniel E. Whitney, "Resolved Motion Rate Control of Manipulators and Human Prostheses," IEEE Trans. 

Man-Mach. Sys., vol . MMS-10, no. 2, June 1969, pp. 47-53. 

[2] T.J. Tarn, A.K. Bejczy, and X. Yun, "Coordinated Control of Two Robot Arms," Proceedings 1986 IEEE 

International Conference on Robotics and Automation, vol. 2, April 7-10, 1986, pp. 1193-1^.02. 

[3] Tatsuzo Ishida, "Force Control <n Coordination of Two Arms," Proceedings the 5th International Joint 
.Conference on Artificial Intelligence. Aug. 1977, pp. 717-722. 

[4] Cecil 0. Alford and S.M. Belyeu, "Coordinated Control of Two Robot Arms," International Conference on 

Robotics, Atlanta, Georgia, March 13-15, 1984, pp. 468-473. 

[5] Samad Hayatl, "Hybrid Position/Force Control of Multi -Arm Cooperating Robots," Proceedings of the IEEE 

International Conference on Robotics Automation, San Francisco, California, April 7-10, 1986, 
pp. 82-89. 


305 


